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Abstract 

This paper presents a procedure for computing the 
aeroelasticity of wing-body configurations on multiple- 
instruction, multiple-data (MIMD) parallel computers. 
In this procedure, fluids are modeled using Euler equa- 
tions discretized by a finite difference method, and 
structures are modeled using finite element equations. 
The procedure is designed in such a way that each disci* 
pline can be developed and maintained independently 
by using a domain decomposition approach. A par- 
allel integration scheme is used to compute aeroelas- 
tic responses by solving the coupled fluid and struc- 
tural equations concurrently while keeping modularity 
of each discipline. The present procedure is validated 
by computing the aeroelastic response of a wing and 
comparing with experiment. Aeroelastic computations 
are illustrated for a High Speed Civil Transport type 
wing-body configuration. 

Introduction 

The analysis of aeroelasticity involves solving fluid 
and structural equations together. Both uncoupled 
and coupled methods can be used to solve problems 
in aeroelasticity associated with nonlinear systems. 1 
Uncoupled methods are less expensive but are limited 
to very small perturbations with moderate nonlinear- 
ity. However, aeroelastic problems of aerospace vehicles 
are often dominated by large structural deformations 
and high flow nonlinearities. Fully coupled procedures 
are required to solve such aeroelasticity problems accu- 
rately. 

Such coupling procedures result in an increased 
level of complication. Therefore, aeroelastic analysis 
has been mostly performed by coupling advanced com- 
putational fluid dynamics (CFD) methods with simple 
structural modal equations or advanced computational 
structural dynamics (CSD) methods with simple flow 
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solutions. However, these approaches can be less ac- 
curate for the aeroelastic analysis of practical problems 
such as a full aircraft configuration in transonic regime. 
It is necessary to develop a fully coupled procedure uti- 
lizing advanced computational methods for both disci- 
plines. 

Recently, coupled fluid-structural interaction prob- 
lems are being studied using finite-difference Euler or 
Navier-Stokes flow equations and finite-element struc- 
tural equations of motion as demonstrated by an aeroe- 
lastic code ENS AERO. 2,3 However, applications are 
limited to simple structural models. For the compli- 
cated fluid and structural models, computations are 
performed in a step-by-step fashion. 4 The main reason 
is that the use of detailed models for both disciplines 
requires unprecedented computing speeds and amounts 
of memory. The emergence of a new generation of par- 
allel computers can possibly alleviate the restriction on 
the computational power. 

In order to solve the coupled fluid-structural equa- 
tions, some attempts have been made to solve both flu- 
ids and structures in a single computational domain 5,6 . 
The main defect of this approach is the ill-conditioned 
matrices associated with two physical domains with 
large variations in stiffness properties. So far, such 
attempts have been limited to simple two-dimensional 
problems. 

To overcome the difficulties arising from a sin- 
gle domain approach, the domain decomposition ap- 
proach reported in Ref. I has been incorporated in sev- 
eral advanced aeroelastic codes such as XTRAN3S, 7 
ATRANS3S 8 and CAP-TSD 9 based on the transonic 
small perturbation theory. This domain decomposition 
approach models fluids and structures independently. 
The coupling of two disciplines is accomplished by ex- 
changing data at interfaces between fluids and struc- 
tures. This allows one to take full advantage of numer- 
ical procedures for individual disciplines such as finite 
difference methods for fluids and finite element meth- 
ods for structures. It was later demonstrated that the 
same technique can be used for modeling the fluids with 
Euler/Navier-Stokes equations on moving grids. 10 * 11 
The accuracy of the coupling is maintained by match- 
ing the surface grid deformation with the structural 
displacements at the surface. This new development is 
incorporated in the computer code. ENS AERO. 12 Sim- 
ilar work has also been reported recently in Ref. 13. 

For the implementation of the ENSAERO code 



on parallel computers, two types of parallel comput- 
ers were considered. These are the single-instruction, 
multiple-data (SIMD) and multiple-instruction, multi- 
ple-data (MIMD) type computers. However, MIMD 
type parallel computers are more suitable for compu- 
tationally efficient implicit solvers and the domain de- 
composition approach used in the ENSAERO code. By 
decomposing the computational domain into a num- 
ber of subdomains and solving an implicit problem on 
each subdomain, a MIMD computer can reduce the in- 
terprocessor communication required for the inversion 
of a large matrix resulting from an implicit method. 
Furthermore, a MIMD parallel computer can exploit 
the parallelism offered by the domain decomposition 
approach for the coupled fluid and structural disci- 
plines; each computational domain can be treated con- 
currently. In addition, each fluid and structural algo- 
rithms can be designed in a modular fashion on MIMD 
parallel computers. 

In this work, a procedure to compute aeroelastic- 
ity on MIMD parallel computers is described. The 
fluid and structural equations on separate computa- 
tional domains are coupled by the exchange of interface 
data. The computational-efficiency issues of parallel in- 
tegration of both fluid and structural equations are in- 
vestigated using a parallel version of ENSAERO. The 
fluid and structural disciplines are modeled using finite- 
difference (FD) and finite-element (FE) approaches, re- 
spectively. The coupled equations are solved using a 
time integration method with configuration-adaptive 
moving grids. The procedure is designed in a modular 
fashion so that each computational discipline can be 
developed independently and be modified easily. The 
aeroelastic computations are demonstrated for a High 
Speed Civil Transport (HSCT) type wing-body config- 
uration on the Intel iPSC/860 parallel computer. 

Aeroelastic Computation 

The governing aeroelastic equations of motion for 
structures can be written as 

[M){q} + [C\{q} + [K){q}= { Z } (1) 

where [Af], [C], and [ K ] are the global mass, damping 
and stiffness matrices, respectively. { Z } is the aerody- 
namic force vector corresponding to displacement vec- 
tor {q}. One of the matin efforts is computing the aero- 
dynamic force vector {Z}, which is obtained by solving 
the fluid flow equations. After obtaining the aerody- 
namic force, aeroelastic responses cam obtained by solv- 
ing eq. (1). A numerical integration technique based on 
the constant-average- acceleration method 14 is used to 
integrate the aeroelastic equations. This is an uncon- 
ditionally stable scheme. 


A domain decomposition approach is selected to 
solve eq. (1) in conjunction with the flow equations. 
Each of the fluid and structural equations is modeled 
in a separate computational domain. Coupling between 
the fluid and structural equations is accomplished by 
exchanging boundary interface data at the end of every 
time step when solving eq. (1). The advantage of this 
approach is that one can select an efficient algorithm 
for the fluid domain regardless of the structural domain 
and vice versa. In this work, a finite difference method 
is selected for fluids and a finite element method for 
structures. 

In the fluid domain the strong conservation law 
form of the Euler equations is used to model the flow. 
To solve the Euler equations, the central-difference 
scheme based on the implicit approximate factorization 
algorithm of Beam and Warming 15 with modifications 
by Pulliam and Chaussee 16 for diagonalization is used. 
The scheme is first order accurate in time. 

To exchange boundary interface data, it is neces- 
sary to represent the equivalent aerodynamic loads (i.e. 
normal stress) at the structural nodal points and to 
represent the deformed structural configurations at the 
aerodynamic grid points. Several numerical procedures 
have been developed to exchange the necessary infor- 
mation between the fluid and structural domains. 17 ” 20 

A node-to-element approach is used to define the 
location of the points of the fluid surface grid relative 
to finite elements at the surface of the structure for 
coupling purposes. In this approach, every grid point 
of the fluid that lies on the fluid-structural interface is 
identified with respect to a finite element as shown in 
Fig. 1. However, in general, it is not straightforward to 
determine the local coordinate information of each grid 
point within a finite element. A numerical inverse map- 
ping technique developed by Murti and Valliappan 21 is 
used to obtain the local coordinate information of all 
the interface points of the fluid grid with respect to 
surface elements of the structure. Once the location of 
each fluid grid point is obtained, the nodal force vec- 
tor can be easily obtained. Also the deformation of the 
fluid surface grid is determined by using shape functions 
of the finite elements used to model the structure. In 
addition, a linear extrapolation is used to compute the 
deformation at the points of the fluid surface grid which 
are not on the surface of the structure, e.g. points at 
singular planes. Starting from the deformed fluid sur- 
face grid, the field grid is generated as explained in a 
later section. 

Parallelization of ENSAERO 

The domain decomposition approach enables data 
structures and solution methods for fluid and struc- 
tural equations to be developed independently. Fluid 



and structural equations are modeled in separate com- 
putational domains. Each domain is mapped individ- 
ually onto a group of processors, referred to as a cube 
on the Intel iPSC/860, which is selected for this work. 
The Intel iPSC/860 is a distributed- memory, multiple- 
instruction, multiple-data (MIMD) computer with 128 
processors. 

Because of coupling between the two disciplines, 
the interface boundary data such as surface pressures 
and structural displacements should be exchanged. 
This exchange between the fluid and structural do- 
mains is accomplished through an inter cube commu- 
nication mechanism. 22 This intercube communication 
facility enables different processors in each cube on the 
iPSC/860 to communicate directly. 

The fluid flow algorithm solves the Euler equa- 
tions using 3-D uni-partitioning of the computational 
domain. The uni-partitioning scheme assigns one sub- 
domain grid to each of the processors. The mapping 
of subdomain grids to processors is described in Fig. 2. 
The arrows denote bi-directional data communication. 
There are a variety, of concurrent algorithms available 
for solving the system of equations for fluids. More 
details about the implementation of the fluid flow algo- 
rithms can be found in Ref. 23. 

For the structural domain, regular finite element 
meshes are used to model the wing and the body as 
plate and shell structures, respectively. The domain 
decomposition is made by using 2-D uni-partitioning 
as shown in Fig. 2. This type of domain decomposition 
enables an efficient and simple message co mmuni cation 
mechanism within the structural domain. 

The solver for the structural domain is based on 
a Jacobi-preconditioned conjugate gradient (JPCG) al- 
gorithm on the Intel iPSC/860. The present JPCG al- 
gorithm is obtained by implementing the diagonal pre- 
conditioner to a parallel conjugate gradient algorithm 
proposed by Law. 24 In this method, the structural fi- 
nite element model is divided into subdomains and only 
local matrices related to the subdomains are assembled. 
The multiplication of a matrix by a trial vector, which 
is the major operation of the conjugate gradient algo- 
rithm, is performed at the subdomain level. Interpro- 
cessor communication is confined to the solution phase, 
and the communication is only performed between pro- 
cessors which have common finite element nodes. 

Aeroelastic Configuration Adaptive Grids 

One of the major difficulties in solving the Euler 
equations for computational aerodynamics lies in the 
area of grid generation. For steady flows, advanced 
techniques such as blocked zonal grids 25 are currently 
being used. However, grid-generation techniques for 
aeroelastic calculations, which involve moving compo- 


nents, are still in the early stages of development. Gu- 
ruswamy has developed analytical schemes for aeroelas- 
tic configuration-adaptive dynamic grids and demon- 
strated time-accurate aeroelastic responses of wing 10 
and wing-body 2 ’ 3 configurations. 

In this work, an H-0 type grid topology is used (H 
in the streamwise and O in the spanwise directions) for 
wing-body configurations. This type of grid topology is 
more suitable for general wing-body configurations. It 
gives better surface grid resolution on the body when 
compared to the C-H grid topology used in Ref. 10. 
The grid is designed such that flow phenomena such as 
shock-waves, vortices, etc. and their movement around 
the wing-body configurations are accurately simulated. 
The base surface grid is prepared using the S3D code. 26 
From the surface grid, the field grid is generated using 
an analytical approach. In this approach, grid lines in 
the radial direction away from the surface are gener- 
ated line by line in the planes normal to the longitudi- 
nal body axis. First, the radial lines are generated ap- 
proximately normal to the surface. Then, the new grid 
lines in the azimuthal direction are generated in such 
a way that the spacing between lines are exponentially 
increased away from the surface. This method can be 
used for generating the base field grid of the rigid con- 
figuration and the aeroelastically deformed field grid of 
the flexible configuration. 

Parallelization of this approach is accomplished us- 
ing the uni-partitioning scheme in the fluid domain. 
The present approach for aeroelastic configuration- 
adaptive grids only requires the deformed surface grid 
and the coefficients used in the exponential function 
to define the grid spacing between lines away from the 
surface. So the interprocessor communication needed 
to generate the deformed field grid within the fluid do- 
main is minimal, and takes place only between proces- 
sors assigned along the surface-normal direction. Each 
of the processors can generate the assigned subdomain 
grid of the deformed field grid concurrently once infor- 
mation about the local surface grid has been broadcast. 

The grid is generated at every time step based on 
the aeroelastically deformed position of the structure. 
First, the displacements at the points of the fluid sur- 
face grid on the structure are obtained on the processors 
assigned to the structural domain. This is done by us- 
ing the local coordinate information and the finite ele- 
ment shape functions. The displacements at the points 
of the fluid surface grid are sent only to the appropriate 
processors on the fluid domain which contain the sur- 
face grid points. Then, a linear extrapolation is used to 
obtain the displacements at the remaining points of the 
surface grid, such as the points at singular planes which 
are not on the surface of the structure. At this stage, 
the deformed surface grid is distributed only to proces- 



Results 


sors of the fluid domain which contain the local surface 
grid points. It should be noted that the deformed sur- 
face grid residing on each processor of the fluid domain 
is only the part of the whole surface grid according to 
the grid partitioning. If two or more processors are as- 
signed along the surface-normal direction, each of the 
deformed surface partitions is sent to processors which 
have the same partitioning indices of the surface grid. 
Finally, all processors of the fluid domain generate their 
subdomain of the deformed field grid concurrently. 

Parallel Integration for Coupled Domains 

In a serial computer, the integration of both 
fluid and structural equations is performed one af- 
ter the other in a sequential nature. Figure 3(a) 
shows the sequential integration scheme implemented 
on MIMD parallel computers. In the sequential inte- 
gration scheme, the fluid domain has to wait to pro- 
ceed to the next time step until it receives information 
about structural deformations. The structural domain 
also has to wait for surface pressure data. So, both 
cubes have their own idle times waiting for data com- 
munications. The computational time per integration 
step will be determined by times spent on both domains 
when a sequential integration scheme is used. In order 
to avoid the idle times between the fluid and structural 
computations, all processors can be used to solve the 
fluid and structural equations sequentially as done in 
serial computations. But this approach requires more 
memory per processor and two disciplines have to be 
implemented in a single program. As a result, modu- 
larity of each algorithm for individual disciplines will 
have to be sacrificed to a significant degree. In addi- 
tion, this approach will be less efficient as increasing 
the number of processors because the problem is not 
linearly scaled. 

However, while keeping modularity of each disci- 
pline, computations can be done more efficiently on 
MIMD parallel computers by executing the integration 
of both fluid and structural equations concurrently as 
shown in Fig. 3(b). In the proposed parallel integra- 
tion scheme, both domains start computations indepen- 
dently and one of the solvers waits until the other fin- 
ishes its calculation. Then they exchange the required 
data with each other for the next time step. By do- 
ing so, the parallel integration can reduce the idle time 
since only one cube (the fastest) will have to wait. The 
resulting speedup by the parallel integration scheme is 
a factor of almost 2, provided that computational times 
required for the fluid and structural domains are well 
balanced. This integration scheme exploit the paral- 
lelism offered by the domain decomposition approach 
to solve the coupled fluid-structural interaction prob- 
lems. 


Wing Aeroelasticity 

In order to validate the present development, com- 
putations were done for a clipped delta wing config- 
uration. 27 The transonic flutter characteristics of this 
wing are available from wind tunnel tests for various 
flow parameters. For this computation, the flow field 
is discretized using a C-H grid topology of size 151 x 
30 x 25. The fluid grid is assigned to 32 processors 
on the iPSC/860. The processors are arranged as a 3- 
D mesh of 8 processors in the chordwise direction and 
2 processors in both the spanwise and surface-normal 
directions. 

A 20 degrees-of-freedom (DOF) ANS4 shell 28 ele- 
ment was used for the finite element modeling of the 
structure. The wing is modeled as a plate. Consider- 
ing the wing model used in the experiment, variation of 
mass density is allowed along the chordwise and span- 
wise directions. But the thickness of the finite element 
model is kept constant. This is based on the assump- 
tions that the stiffness of the wing is do min ated by an 
aluminum- alloy insert and that the mass distribution of 
the wing is significantly changed due to plastic foams 
covering the aluminum- alloy insert. For the structures 
part of the computation, processors were assigned as a 
2-D mesh of 2 processors in the chordwise and spanwise 
directions, respectively, on the iPSC/860. 

In order to compare sequential and parallel in- 
tegration schemes, the aeroelastic responses were ob- 
tained using both schemes on the iPSC/860. The re- 
sults are presented in Fig. 4. The responses were ob- 
tained for 0° angle of attack (AoA) at Moo = 0.854 and 
a given dynamic pressure of 1.0 psi. The two results 
agree well. For 256 finite elements (1360 DOF.) with 4 
processors on the structural domain, the computational 
times per integration step are 6.22 and 3.33 seconds by 
using sequential and parallel integration schemes, re- 
spectively. A speedup factor of 1.87 is achieved by using 
the parallel integration scheme. The parallel integra- 
tion scheme enables concurrent solution of the coupled 
fluid and structural equations without causing any sig- 
nificant inaccuracy or instability problems. The com- 
putation time per integration step required is deter- 
mined by the computational domain that requires most 
time per integration step. This parallel integration is 
one of the advantages of using MIMD computers for 
multidisciplinary analysis. 

Aeroelastic responses were also computed for var- 
ious other dynamic pressures in order to predict the 
flutter dynamic pressure and compare with the exper- 
iment. Figure 5 shows the stable,' near neutrally sta- 
ble, and unstable responses of wing tip displacements 
at the leading edge for dynamic pressures of 0.80, 0.85, 


and 0.90 psi, respectively. From the responses shown in 
Fig. 5, the interpolated dynamic pressure for the neu- 
trally stable condition is 0.84 psi. It is noted that the 
experimental dynamic pressure measured at the neu- 
trally stable condition was 0.91 psi. 27 Considering the 
lack of experimental pressure data on the wing and the 
error involved in modeling the wing as a plate with con- 
stant thickness, the computational result is deemed an 
acceptable prediction of the flutter dynamic pressure. 

Wing-Body Aeroelasticity 

The main purpose of this work is to compute aeroe- 
lastic responses of fully flexible wing-body configura- 
tions on MIMD parallel computers. For this purpose, a 
general-purpose moving-grid capability is required. In 
the present work, an analytical scheme 3 that will gener- 
ate a moving H-0 grid is implemented on the iPSC/860. 
This scheme generates the field grid according to the 
surface grid deformation. For demonstration purposes, 
an HSCT type wing-body configuration (1807 model) 
is selected. Figure 6 show the baseline grid. The size of 
the baseline grid is 95 x 89 x 30. However, it should 
be noted that the technology developed in this work for 
moving grid is independent of grid size. The grid gen- 
erated by the code when the structure is deformed is 
shown in Fig. 7. Note that the singular planes upstream 
of the leading edge and downstream of the trailing edge 
are deformed according to the deformed shape of the 
configuration. 

In order to verify the coupling of the surface move- 
ment with the grid movement, dynamic aeroelastic re- 
sponses are obtained for the above wing-body config- 
uration. Both the body and wing are allowed to be 
flexible. The wing-body configuration is modeled as 
a plate/shell structure using 308 elements. The finite 
element layout is shown in Fig. 8. The structural prop- 
erties are chosen so that the structure can demonstrate 
aeroelastic responses for a given flow condition. Sym- 
metric boundary conditions are applied at the top and 
bottom of the body symmetry lines. All DOF are fixed 
along the bottom symmetry line of the mid-body. This 
results in a total of 1641 DOF for the structure. 

Aeroelastic computations are done on the flexible 
wing-body configuration by directly coupling the pres- 
sures computed solving the Euler equations with the 
FE structural equations of motion. A demonstration 
calculation is done for a dyn ami c aeroelastic case when 
the configuration is ramping up from 0° to 5° AoA 
at Afoo = 2.1 as shown in Fig. 9. This ramping mo- 
tion is started from the steady state of 4.75° AoA and 
Moo = 2.1. It is assumed that the wing root is 300 
inches long and aeroelastic computations are done at 
a dynamic pressure of 3.0 psi. The configuration is 
pitched up about the axis perpendicular to the symme- 


try plane and located at the leading edge of the wing 
root. Starting from the steady state solution, the con- 
figuration is pitched up at* a rate of 0.0015 degrees per 
time step. At the end of each time step a new field 
grid is generated that conforms to the deformed sur- 
face. Figure 9 shows the response of the leading edge 
of the tip section. It is noted that the wing continues 
to oscillate after the ramp motion has stopped. This is 
because the inertial force on the struct Tire is still dom- 
inating the aeroelastic motion. 

The effect of aerodynamic forces on the aeroelastic 
responses is studied as shown in Fig. 10. The compu- 
tations are started from the steady state solution at 
4.75° AoA and Mqo = 2.1 with an initial motion of the 
structure due to uniform accelerations to simulate gust 
loads. When aerodynamic forces are not applied, the 
structure is oscillating without decrease in amplitude. 
But the magnitude of the wing tip deflection is negli- 
gible. Upon applying aerodynamic forces, the wing tip 
deflection becomes significant. However, the aerody- 
namic damping reduces the amplitude of the structural 
responses gradually. 

Performance 

In order to measure the performance of the struc- 
tural domain on the Intel iPSC/860, the FLOP (float- 
ing-point operations) rate on the iPSC/860 is calcu- 
lated by comparing time per integration step on the 
iPSC/860 to the time on the Y-MP using a single 
processor. Operation counts from the Cray Hardware 
Performance Monitor are used. A single processor 
of the iPSC/860 achieve the Y-MP equivalent of 4.2 
MFLOPS, while the corresponding rate is about 77 
MFLOPS on a single Y-MP processor. The Intel rate 
is about 7 percent of the peak performance of a sin- 
gle processor on the iPSC/860. S imil ar performance 
was reported by Ryan and Weeratunga 21 for the fluid 
domain. All performance data reported are for 64-bit 
arithmetic. 

The performance of the structural domain in par- 
allel ENSAERO has been measured over a wide range 
of processor numbers and problem sizes as shown in 
Fig. 11. The speedup relative to the Y-MP is defined 
as 

t tCray 

speedup = - 

tlntel 

where tcray and tjntei are the computational time 
per integration step measured on the Y-MP and the 
iPSC/860, respectively. Only a single processor is used 
to measure tcray on the Y-MP. The open and filled 
symbols denote the domain decomposition approach 
which results in the minimum and maximum band- 
widths of the stiffness matrix of each subdomain for 
a given number of processors, respectively. 


For the case of 1,360 DOF, the computational time 
per integration step for 64 processors on the iPSC/860 
is close to that on the Y-MP. However, by increasing the 
size of the problem (10,560 and 20,800 DOF), 16 pro- 
cessors of the iPSC/860 achieve about the same speed 
as a single Y-MP processor. It is evident that the JPCG 
solver on the iPSC/860 performs better as the size of 
problem increases. For the case of 20,800 DOF, the rel- 
ative speedup achieved is about 8 when 64 processors 
are in use on the iPSC/860. 

The overall performance of ENSAERO on both the 
Y-MP and the iPSC/860 is shown in Fig. 12 for the case 
of 113,250 grid points for the fluid domain and 10,560 
DOF for the structural domain. In this computation, 
32 processors are assigned to the fluid domain and 16 to 
64 processors to the structural domain. Both the sky- 
line reduction and JPCG solvers are compared on the 
Y-MP while only the JPCG solver is used for the struc- 
tural domain. The height of each column stands for the 
time per integration step. Each col umn is divided into 
times spent for the fluid domain, the structural domain, 
and for idle/intercube communication. 

For the structural domain, it is evident that the 
skyline reduction solver outperforms the JPCG solver 
on the Y-MP. However, the JPCG solver is first imple- 
mented on the iPSC/860. Direct solvers are still un- 
der development on parallel computers. The main pur- 
pose of this work is to compute aeroelastic responses 
of aerospace vehicles on MIMD parallel computers. 
Therefore the well-developed JPCG solver is selected. 
Due to the domain decomposition approach used in this 
work, the JPCG solver can be easily replaced with more 
efficient solvers when they become available. 

When using 32 processors for the structural do- 
main, the JPCG solver on the iPSC/860 achieves the 
performance of the skyline reduction solver on the Y- 
MP. The time per integration step of ENSAERO using 
96 processors in total on the iPSC/860 is about 60% of 
that obtained using the skyline reduction solver with a 
single processor on the Y-MP. This result is based on 
the computation time for the case of 113,250 CFD grid 
points and 10,560 structural equations. It should be 
noted that the structural domain determined the time 
per integration step for this particular problem on the 
iPSC/860. Most of the time on the fluid domain was 
spent waiting for the interface boundary data. How- 
ever, due to the domain decomposition approach, it is 
possible to balance the computational time between the 
two domains by assigning more processors to the struc- 
tural domain. 

Conclusions 

A parallel wing-body version of a multidisciplinary 
code, ENSAERO, has been developed on the Intel 


iPSC/860. A domain decomposition approach was used 
to enable algorithms for the fluid and structural disci- 
plines to be developed and maintained independently. 
This approach provides an efficient and effective envi- 
ronment to researchers. A researcher working in the 
fluid or the structural discipline can develop his own 
algorithms independent of the others. Coupling of the 
disciplines is achieved by exchanging boundary data 
through an intercube communication mechanism. This 
makes it easy for each discipline to incorporate and 
develop new algorithms or data structures without in- 
terferences. 

The performance of the structural domain is far 
behind that of the fluid domain. This is due to the 
less desirable performance of the JPCG algorithm. It 
is noted that direct solvers are still in the early stages of 
development. However, since the procedure developed 
here allows for one domain to select algorithms inde- 
pendent of others, the JPCG algorithm can be easily 
replaced with more efficient algorithms when available. 
Although the solver for the structure is not efficient on 
a serial computer, reasonable computational speed and 
a good load balance can be achieved by assigning more 
processors to the structural domain. The overall time 
per integration step of parallel ENSAERO using 96 pro- 
cessors on the iPSC/860 is reduced to about 60% of the 
best time obtained on a single Y-MP processor for the 
particular problem considered. This shows the advan- 
tage of using the domain decomposition approach for 
the multidisciplinary analysis on MIMD parallel com- 
puters. 

The parallel integration scheme enables the com- 
bination of advanced CFD and CSD technologies with 
min im al increase in computational time per integration 
step while keeping modularity of each discipline. The 
time per integration step is solely determined by the 
domain that requires most computational time on the 
iPSC/860. This parallel integration is one of the advan- 
tages of using MIMD computers for multidisciplinary 
analysis. The procedure developed in this research will 
provide an efficient tool for solving aeroelastic problems 
of complete aerospace vehicle configurations on MIMD 
computers. 
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Fig. 1:A schematic diagram of the node-to-element 
approach for the fluid-structural interface. 
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(a) Sequential integration 


Fig. 2: Processor arrangements and message ex- 
changes through interprocessor and intercube commu- 
nications. 




(b) Parallel integration 


Fig. 4: Aeroelastic responses obtained by using se- 
quential and parallel integration schemes. (M^ = 
0.854, a = 0°, P= 1.0 psi) 


Fig. 3: Flow diagrams for sequential and parallel in- 
tegration schemes. 


















Fig. 5: Aeroelastic responses of a clipped delta 
wing obtained by solving finite-difference Euler equa- 
tions and finite-element structural equations of motion. 
(Moo = 0.854, a = 0° ) 




Fig. 6: An HSCT type wing-body configuration with Fig. 8: Finite-element modeling of the wing-body con- 
portions of surface and field physical grids. figuration. 
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Fig. 9: Dynamic aeroelastic displacements at the Fig. 'll: Computational performance of the structural 
wing-tip leading edge of an HSCT type wing-body with domain in ENSAERO with various problem sizes and 

ramp motion. (Moo = 2.1, o = 4.75°, P= 3.0 psi) domain decompositions on the Intel iPSC/860 
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Fig. 10: Effect of aerodynamic forces on the aeroelas- 
tic responses of an HSCT type wing-body. (Moo = 2.1, 
a = 4.75°) 
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Fig. 12: Overall computational performance of EN- 
SAERO on the Cray Y-MP and the Intel iPSC/860. 



